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(g) Coded modulation with unequal error protection. 



Dioital sianals (from 101). such as digital television signals, are subjected to a source coding step (tjy 
® ^Xx^^tli^^^^^ step (by 114 and 115). The source coding step causes the s-gnal to 

be reprSed by first and second data streams (on 105. 106). The first slrearn carnes data regarded as 
mo e^mS and the second carries data regarded as less important In t^^^^^""^' ;^PS.o^ of 
me mL^?ing is such that the data elements of the various data strearns have d.ffenng P«>babfl .es o 
being erroneously detected at the receiver. The channel mapping step includes at '^a^t one multHleve^ 
ceding step. The signal constellations used in the channe mappmg step J^^'^'^^^'J^Z 
^oersvrnbols in which the distance between the symbols comprising al least ones of the supersymbois 

le s'man a parameter referred to as the maximum intra-subset distance (MID) Add'ho^^^^^^^^^^^ 
^nslellalions. ihe minimum distance between at least ones of the sj^t>°'^,°i,^ 
suoersvmbols is greater than the minimum distance between the symbols of the constellatton as ^ 
ZMe again, still being less than the MID. The first data stream used ^Jf^Jj^^.^^^"?^^^^ 
Ipersymbcis. whde the second data stream is used to select particular symbols from the .dentrfied 
supersymtwis. 
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Background of the Invention 

The present mvention relates to Ihe transmission of digital data including, particularly, the transmission 
of digital data which represents television (TV) signals. 
5 It is generally acknowledged that some form of digital transmission will be required for the next generation 

\ of television technology, conventionally referred to as high definition television, or HDTV. This requirement is 

\ due mostly to the fact that much more powerful video compression schemes can be Implemented with digital 

signal processing than with analog signal processing. However, there has been some concern about getting 
^ committed to an all-digital transmission system because of the potential sensitivity of digital transmission to 

10 small variations in signal-to- noise ratio, or SNR, at the various receiving locations. 

This phenomenon-sometimes referred to as the "threshold ef fecl"-can be illustrated by considering the 
case of two television receivers that are respectively located at 50 and 63 miles from a television broadcast 
station. Since the power of the broadcast signal varies roughly as the inverse square of the distance, it Is easily 
verified that the difference in the amount of signal power received by the television receivers is about 2 dB. 
iS Assume, now. that a digital transmission scheme is used and that transmission to the receiver that is 50 miles 
distant exhibits a bit-error rale of 10-«. If the 2 dB of additional signal loss for the other TV set translates into 
a 2 dB decrease of the SNR at the input of the receiver, then this receiver will operate with a bit-error rate of 
about 10-*. With these kinds of bit-error rates, the TV set that is 50 mHes away would have a very good re- 
ception, whereas reception for the other TV set would probably be very poor. This kind of quick degradation 
20 in performance over short distances is generally not considered acceptable by the broadcasting Industry. (By 
comparison, the degradation in performanceforpresentlyusedanalogTVtransmissionschemes is much more 
graceful) 

There is thus required a digital transmission scheme adaptable for use in television applications which over- 
comes this problem. Solutfons used in other digital transmission environments- such as the use of a) regen- 

25 erative repeaters in cable-based transmission systems or b) fall-back data rates or conditioned telephone lines 
in voiceband data applications- a re clearly inapplicable to the free-space broadcast environment of television. 

An advantageous technique for overcoming the shortcomings of standard digital transmission for over-t he- 
air broadcasting of digital TV signals- referred to herein generically as "unequal- error- protect ion signaling*- 
comprises a particular type of source coding step followed by a particular type of channel mapping step. More 

30 specifically, the source coding step causes the television signal to be represented by two ormore data streams 
while, in the channel mapping step, the mapping is such that the data elements of the various data streams • 
have differing probabilities of channel-induced error, i.e., different probabilities of being erroneously detected 
at the receiver. Illustratwely, a first one of the aforementioned data streams carries components of the overall 
television signal which are regarded as the most important-for example, the audio, the framing information. 

35 and the vital potions of the video information-and that data stream is mapped such that its data elements 
have the lowest probability of channel-induced error. A second one of the data streams carries components 
of the overall television signal which are regarded as less important than those of the first data stream and 
that data stream is mapped such that its data elements have a probability of channel-induced error that is not 
as low as those of the first data stream. In general, it is possible to represent the overall television signal with 

« any number of data streams, each carrying components of varying importance and each having a respective 
probability of error. This approach allows a graceful degradation In reception quality at the TV set location be- 
cause, as the bit error rate at the receiver begins to increase with increasing distance from the broadcast trans- 
milter, it will be the bits that represent relatively less important portions of the TV signal information that will 
be the first to be affected. 

45 In a scheme which implements the above-described overall concept in which different levels of error pro- 

lection are provided for different classes of data elements generated by the source enclosing step, but which 
provides enhanced noise immunity via the use of coded modulation, such as trellis-coded modulation, the sym- 
bols in a predetermined 2N-dimens(onal channel symbol constellation. Nil, are divided into groups, each of 
which is referred to as a "supersymbol." During each of a succession of symbol intervals, a predetermined nunv 
\ 50 ber of the most important data elements are channel encoded, and the resulting channel coded data elements 

\ . identify a particular one of the supersymbols. The remaining data elements, which may also be channel en- 

coded, are used to select for transmission a particular symbol from the identified supersymbol. 

The approach as thus far described is similar In a general way to conventional coded modulation schemes 
in that the latter also divide the channel synibols into groups, typically referred to as "subsets." However, in 
55 conventional coded modulation schemes, the subsets are formed under the constraint that the minimum Eu- 
clidean distance (hereinafter referred to as the "minimum distance") between the symbols in a subset is greater 
than the minimum distance between the symbols in the constellation as a whole. In the described approach, 
however, the minimum distance between the symbols of a supersymbol is the same as the minimum distance 
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between the symbols in the constellation as a whole. This distance property allows (orgfeaterarnount of noise .. 
imrnunily for the most impdrtaht'data elements thah fo^^^^^ 

bv keeping the minimum distance between supersyrnbols as t^rge.as.pbssible-Hisually greater than the mmK 
mum distance between the symbols of th^ constellation, SpedficaHy. Orwe the supcrsymbols are defined, .t , 
5 is possible to design codes for the most Important data elements leased on the dtstances between the super- 
symbols i e as though each supersymbol.were a wnverUional symbol/in a conventionai consleltation. The 
being so. a particular degree of noise immunity can be.achieyed fq|r the most jmpwtant data elements that is - 
greater than what bn be achieved for the other ' 

iO Summary of the Invention 

The present invention provides the desigher of upe(^ua^er^o^protection signaling schernes of the above- 
described type with additional flexibility'. In:acc6rdance wHh Ihe'.th^^^ coding is us^ed ; ; 

to code the data elements of at least one of the data streams that are inpuVtb the channel mapping step.. F^r ! 
IS example, multi-level coding can be used to code the data ele rhente which ylt'imately determine the supersym- ; . 
bol selection. Alternatively, it may be use^ to:cpd^ the data elerhents which deternvne the se ection 6f a p^r- . 
licular symbol from within a .setected supersymbot, Or muUi-level coding can. t>e used for both streams. The. 
particular way in which the multi-level coding is used >yni depfend onthe rectuirements of any partrciil^ appli- 
cation in terms of the degree of error protection desired to be afforded to any particular d ass of the data being 

code^d^^^^ are at least two important advantages to this approacti. One is that it provides an enhanced flexibility 
in designing a channel coding to realize a desired percentage of the overall data stream being coded that is 
to be regarded, and treated, as most important. Another advantage is that it provides an enchanced flexibility 
in apportioning the available redundancy between the most important data and the less important data, there- 
25 by providing a mechanism for achieving particular desired different levels of error protection for those two 
classes of data. A yet further advantage is that this approach allows differential levels of protechon to be af- 
forded to substreams of data elements within any of the streams that are multi-level coded in accordance w.lh 

the invention. , u • 

Multi-level coding per se is a technique already known in the prior art. In accordance with that technique, 
30 data elements to be coded are divided into two or more substreams. Each of one or more of the substreams 
is then individually redundancy coded using a code of any desired type. The individual encoded substreams- 
-along with any substreams that were left uncoded-form the output of the multi-level code. That output is then 
used in the prior art to identify channel symbols of a predetermined constellation for transmission over a chan- 
nel However, the prior art does not encompass the teaching. lying at the heart of the present invention, that 

35 muttMevel coding can be advantageously used to code one or more of the data streams of an overall unequal- 
error-prolection signaling scheme. 

Advantageously, particular desired combinations of a) coding gain for the most important data elements, 
b) coding gain for the less important data elements, and c) percentage of most important data elements are 
more readily achievable by incorporating one or more multi-level codes in an unequal-error-proteclion signahng 

40 scheme in accordance with the invention, than when singte-ievel codes are used. From the coding theory 
standpoint, this result can be understood as arising out of the fact that the invention allows the redundancy 
introduced into the overall coding scheme to be allocated in virtually any desired proportion between the coding 
of the most important data elements and coding of the less important data elements. 

45 Brief Description of the Drawing 

FIG. 1 is a block diagram of a transmitter embodying the principles of the invention; 
fig! 2 is a block diagram of a receiver for signals transmitted by the transmitter of FIG. 1; 
FIG. 3 depicts a prior art signal constellation; 
50 FIG. 4 depicts a signal constellation illustratwely used by the transmitter of FIG. 1; 

FIGS. 5 and 6 show Olustralive multi-level coders used in the transmitter of FIG. 1 in accordance with the 

invention; ctr- 
FIG 7 depicts a signal constellation that can alternatively be used by the transmitter of FIG. 1, 
FIG 8 depicts a signal constellation of the type typically used in equal error protecbon schemes; 
55 FIGS. 9-14 depict further signal constellations that can alternatively be used by.the transmitter of FIG. 1; 

FIGS. 15 and 16 show illustrative multi-stage decodes used in the receiver of FIG. 2 in accordance with 
the invention. 



EP 0 540 231 A2 

Detailed Description 

Before proceeding with a description of the illustrative embodiments, it should be.noled that various ones 
of the digital signaling concepts described herein are al| well known in; for example, Ihe digital radio and voi- 
ceband data transmission (modem) arts and Itius need not be described in detail herein. These indude such 
concepts as mullidimensiorial signaling using 2N-dimensionaIchahKel symbol constellations, where N is some 
integer, frellis coding; scrambling; passband shaping; equalization; Viterbl. ormaxlmum-likelihood, decoding;! 
etc. These concepts are described in such U.S. patepts as U.S. 3,810^021. issued May 7, 1974 to LKalel et 
al.; U.S. 4.015,222. issued March 29, 1977 to J. Werner; U.S. 4,170764, Issued October 9, 1979 to J. Salz et 
al,: U.S. 4.247.940. issued January 27, i 981 to K. H/Mueller etal.; U.S. 4;304.9^^^^ 1981 
to R. D. Fracassi et al; U.S..4,457,004, issued June 26, 1984 to A. Gersho et al.;-U:S. 4.489,418, issued De- 
cember 18, 1984 to J. E. Mazo; U.S. 4,526,490, issued May 28, 1985 to L. Wei;^nd U.S. 4.597,090, issued 
June 24, 1986 to G. D. Forney, Jr. ; . ^ ^' 

It may also be noted before proceeding that various signal leads showrik the FJGS. may carry analog 
signals, serial bits or parallel bits, as will be clear from the context ;.. 

Turning now to FIG. 1, television (TV) sighal source lOl generates, an analog video signal representing 
picture information or "intelligence,* which signal is passed on lb source encoder 1041 The latter generates a 
digital signal comprised of data eleriiehtsln Which at least one'subset of the data elements represents a portion 
of the information, or intelligence, that is more important than the portion of the inforrrialion. or intelligence, 
represented by the rest of the data elements. Illustratively, each data element is a data bit, with an average 
m+k information bits being generated for each of a succession of symbol intervals. The symbol intervals are 
comprised of N signaling intervals, where 2N is the number of dimensions of the constellation (as described 
below). The signaling intervals have duration of T seconds and, accordingly, the symbol intervals each have 
a duration of NT seconds. The embodiments explicitly disclosed herein happen to use two-dimensional con- 
stellations, i.e., N = 1. For those embodiments, then, the signaling intervals and the symbol intervals are the 
same. 

Of the aforementioned m+k information bits, the bits within the stream of m bits per symbol interval, ap- 
pearing on lead 105, are more important than the bits within the stream of k bits per symbol interval, appearing 
on lead 106. 

The bits on leads 105 and 106 are independently scrambled in scramblers 110 and 111, which'respectively 
output m and k parallel bits on leads 112 and 113. (Scrambling is customarily carried out on a serial bit stream. 
Thus although not explldtly shown in FIG. 1, scramblers 110 and 111 may be assumed to perform a parallel- 
lo-serial conversion on their respective input bits prior to scrambling and a serial- lo-parallel conversion at their 
outputs.) The signal is then channel mapped. In particular, the respective groups of bits on leads 112 and 113 
are extended to channel encoders 114 and 11 5 which generate, for each symbol interval, respective expanded 
groups of r and p bits on leads 121 and 122, where r > m and p > k. The values of those bits jointly identify a 
particular channel symbol of a predetermined constellation of channel symbols (such as the constellation of 
FIG. 4 as described in detail hereinbelow). Complex plane coordinates of the identified channel symbol are 
output by constellation mapper 131. illustratively realized as a lookup table or as a straightforward combination 
of logic elements. Conventional pass- band shaping and television modulation are then performeb by passband 
shaper 141 and television modulator 151. respectively. The resultant analog signal is then broadcast via an- 
tenna 152 over a communication channel, in this case a free-space channel. 

In order to understand the theoretical underpinnings of the invention, it wDI be useful at this point to digress 
to a consideration of FIG. 3. The latter depicts a standard two-dimensional data transmission constellation of 
the type conventionally used in digital radio and voiceband data transmission systems. In this standard 
scheme-conventionally referred to as quadrature-amplitude modulation (QAM)-dala words each comprised 
of four information bits are each mapped Into one of 1 6 possible two-dimensional channel symbols. Each chan- 
nel symbol has an in- phase, or I, coordinate on the horizontal axis and has a quadrature-phase, or Q, coordinate 
on the vertical axis. On each axis, the channel symbol coordinates are ± 1 or ± 3 so that the distance between 
each symbol and each of the symbols that are horizontally or vertically adjacent to it is the same for all symbols 
—that distance being *2". As a result of this uniform spacing, essentially the same amount of noise immunity 
is provided for all four Information bits. 

As is well known, it is possible to provide improved noise inrtmunity without sacrtf kzing bandwidth efficiency 
(information bits per signaling interval) using a coded modulation approach in which an "expanded* two-di- 
mensional constellation having more than (in this example) 16 symbols is used in conjunction with a trellis or 
other channel code. For example, one can use a 32-symbol. two-dimensional constellation together with an 
8-state trellis code to achieve approximately 4 dB of enhanced noise immunity over the uncoded case of FIG. 
3. while still providing for the transmission of four information bits per signaling interval. Here, too, however. 
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It .k amrtiintnf noise immunity is provided for all (our information bits. 

ulatrracheved while providing dKrerent levels of protection against channeMnduced errprfor d.ffejen 
daises of bt sped^^ is possible to achieve a level of error protection tor a dass^ o most .jjporlanl, 
bitewWctls ubsl^m^^^^ 
"approthM^^^^ 

""Ihe constellation used in the transmitter of FIG. 1 is Illustratively the tw(^dimensional 32.syrnbol constel- 
lation shown in FIG. 4. The symbols in the signal constellation are divided into groups re err^ te as ^super- 
sibo s ■ Spedfically. the conslellalion of FIG, 4 is divided Into'a- 2* ^ 4 .upersymbols. In ,th« exarnple; the .. . 
Tnts in\he four quadrants constitute respective supersyiT^bols. as denoted by a* 
The supersyn,bols are denoted generically as O,.,, where b, - 0.1 and = 0,1. The four supersymbols are 

''"l^his":x=^pie!m = 'l':625 and k = 2.125 so that.he overall bit rate is3,75.bits p.ers>^bd with 43,33% , 

of the Wte be^ in he class of most important bits. (The manner « which such fradlonal average b.l rales , 

"ell bethlTd In practice wHI become dear as th". description »ntinues.) E,.ode^1 ^^^^ Z 
0.375 redundant bits for every 1.625 bUs that are input to encoder 114 so that r - 2 En«K)er 115 

age 0.875 redundant bits for every 2.125 bits that are input to = 
121 identify one of the four supersymbols and the p = 3 symbols on lead 122 select a particular one o he 
gh Channel symbols within the identified supersymbol. The partitionlngo the constella,on.s^ 

minimum distance between the symbols of a supersymbol-that distance be.ng denoted as .n FIG. 4..,s the, 
~rtheminlmumdistancebLeenlhesymbolsintheconstella.lonasawhole.Giventh.^^^^^^^^^^^^ 

increased noise immunity for the most important bits can be provided via appropnate selection of a) the codes 
mplemented by encoders 114 and 115 and b) the ratio d,/dr-where d, is the minimum distance between the 
supersymbols. (The parameter cf, is given by the minimum of the distances between an the pairs of sopersym- 
bols. Jth the distance between any pair of supersymbols being the minimum distance between any symbol 
of one of the pair of supersymbols and any symbol of the other.) . . k 

Specficany. a coded modulation scheme can now be constructed for Ihe most «iportanl bits as though 
the four supersymbols were tour conventional symbols in a conventional constellation. To design such a coded 
modulation sd>eme. the tour supersymbols are partitioned, as is conventional, into P'^<'«f'"";f ^ ""T 
of subsets. In this case, there are two subsets, where the value of 6, denotes which subset each of the su- 
persymbols belongs to. Thus, one subset, referred to as subset -O". comprises supersymbols n„„ and n,, and 
the oAher. referred to as subset 'V. comprises supersymbols n,, and n,,. An appropriate code ,s used to en- 
code the most ^nportant input bits to gene^te a stream of coded output bits which a) '^-^'-^-^ir^l^l^^^^ 

' these subsets and b) foreach subset of Ihe sequence, selecla P^'''^"'^' ^"f "'^'"'^ " T"^ 
less important bits are then used to select for transmission a particular symbol from each of the Ihus-se ected 
supersymbols. lnthise«mple,asalreadyseen,thfelaner selection also involvesthe use ofcode^^ 

m accordance with the present invention, at least one of the channel encoders implements a ™l>'-'e''el 
co de. In thii examp TeTin^articSgrTSotrorthem do. As noted earlier, a multi-level code is one in which the 

' data elements-in this embodiment, bits-lo be coded are divided into two °' -""^ ^""^^''"T^E^^h °f °ne 
or more of Ihe substreams is then individually redundancy coded using a code o any desired 'yP«- Jhe indi- 
v[dual encoded substreams-along with any substreams that were left uncoded-form the output of the multi- 

'""prrtfcular illustrative embodiments for encoders 114 and 115 are shown in F'SS 5 and 6.;«pectively^ 
5 Encoder 114 implements a twivlevel code and. as such, indudes coders^-coders 1141 and ^l^^-J^^'^ 
dundancy code hnplemented by coder 1141 is a conventional rate R = 7/8 zero-sum panQr che* code such 
as show^ in G C. Clark. Jr. and J. B. Cain. Frmr-nnrreclion Coding tor Digital Communiya'ions New Yorle 
pLnu J 1981) The redundancy code implemented by coder 1142 is a conventional rate R = 3f4 punc^red 
"utiLal Lie such as shown inY.Yasudaetal. -High-rate punctured convolutionalcodes^^ 
» wTr^i decoding.- IFFH Trans. Comm.. Vol. COM.32. 1984. pp. 315-318. In operation, a senaMc^para el S^) 
cSer^44 ^ thin encoder 114 tak es in 13 bits over 8 symbol intervals, yielding an average input bit .Ble 
o?^ =1 62Vbas"^^ interval as noted earlier. The output of converter 1144 comprises 

oS^^.lnonesubstream.thebitsareprovidedinparallel9roupsofseventocoder114l.lnthe^^^^^^^^ 
^he Wis are provided in parallel groups of sU to coder 1142. For every group of seven input bits, coder 1141 

» genelseigZuSub^^^ 

bits. coder1142generates eight outputbits which are applied to 8.bll butter 1148. The contents 01^^^^^^^ 

and ^48 are read out synchronously in such a way that a pair of bits-one from each of Ihe two butters-is 
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provided on lead 121 for each symbol interval. These bits are the aforementioned bits and 64. As such, ihe 
former Identifies one of the two subsets "0" and "1" and the other identifies one of the two supersymtjbis frorfi 
the identified subset, the two bits bj and thus identifying one of the four supersymbols n^, flot. ri,© and 

Encoder 115 implements a three-level code and. as such, includes coders 1151, 1152 and 1153. Coders 
1151 and 1152 implement the same codes that are implemented by coders 1141 and 1142^ respectively. Coder 
1153 implements a rate R = 1/2 convolutional code such as shown in the aforementioned Clark and Cain text. 
In operation, a serial-lo- parallel {SIP) converter 1154 lakes in 17 bits over 8 symbol intervals* yielding an aver- 
age input bit rate of k = 2.125 bits per symbol interval, as noted earlier. The output of converter 1154 conriprises 
three substreams of bits. In one substream, the bits are provided in parallel groups of seven to coder 1151. In 
the second stream, the bits are provided in parallel groups of six to coder 1152. In the third group, the bits are 
provided in parallel groups of four to coder 1153, For every group of seven input bits, coder llSl .geherates 
eight output bits which are applied to 8-bit buffer 1157. For every group of six input bits, coder 1152 generates 
eight output bits which are applied to B-bit buffer 1158. For every group of four input bits, coder 1153 generates 
eight output bits which are applied to 8-bit buffer 1159. 

The contents of buffers 1157. 1158 and 1159 are read out synchronously in such a way that three bils-1 
one from each of the three buffers-are provided on lead 122 for each symbol interval. These three bits- 
denoted bj, by and 60- select a particular symbol from the supersymbol Identified at the output of encoder 
114. To this end, each of the symbols in the constellation is labelled with a three-bit label as shown In FIG. 4, 
These three bits are, in fact, the aforementioned bits bj, b, and b^. 

The symbols of each supersymbol are partitioned at a first level of partitioning into two subsets. Each sub- 
set is comprised of four symbols as denoted by the labelled bo value. Thus orie subset Is comprised of the four 
symbols denoted 000, 010. 100 and 110 and the other subset is comprised of the four symbols denoted 001. 
011. 101 and 111. The symbols of each of these subsets are partitioned at a second level of partitioning into 
two second-level subsets, which are identified by their labelled bo and 6, values. Each second-level subset is 
comprised of two symbols identified by bj. 

The assignment of three-bit labels to the symbols of each supersymbol is not arbi.lrary. Rather, the codes 
implemented by coders 1151, 1152 and 1153 are selected taking into account the minimum distance between 
the subsets at each level of partitioning. In particular, the most powerful, i.e., lowest-rate, code-in this case 
the rate R ~ 1/2 code implemented by coder 1153-is used at the first level of partitioning to generate b© be- 
cause the minimum distance between the subsets at the first level is the smallest, that distance being d,. The • 
second- and I east- powerful codes, the rate R = 3/4 and rale R = 7/8 codes implemented by coders 1152 and 
1151, respectively, generate by and 62, respectn^ely, because the minimum distance between the second-level 
subsets is greater by a factor of V2 than that of the first level minimum distance whereas the minimum distance 
between the symbols in each second-level subset is greater by a factor of 2 than the first-level minimum dis- 
tance. 

The advantages provided by such use of multi-level codes in an unequal error protection signaling scheme 
are discussed hereinbelow. First, however, reference is made to the receiver of FIG. 2. 

In particular, the analog broadcast signal is received by antenna 201 ; subjected to convenliortal teievislon 
front- end processing in processing unit 211 including, for example, demodulation; and converted to dfrgital form 
by A/D converter 212. The signal is then equalized by passband channel equalizer 221. which generated a 
signal representing the equalizer's best estimate as to t he I and Q component values of the fransmltted symbol. 
This estimate, which is referred to hereinbelow as the "received symbol signal," is passed on parallel rails 222 
and 223 to be channel decoded by channel decoders 231 and 232. The function of channel decoder 231 is to* 
identify the most likely sequence of supersymbols. while the function of channel decoder 232 is to identify the 
most likely sequence of symbols, given that sequence of supersymbols. The output of decoder 232 on lead 
234 thus comprises the bits 63 and b,. while the output of decoder 231 on lead 233 thus comprises the bits 
bo, b) and bj. 

Since the streams of most-important and less-important bits are, In this embodiment, both multi-level cod- 
ed, the channel decoders 231 and 232 must each be multHevel decoders. Straightforward maximum likelihood 
decoding, such as a Viterbi decoding, could be employed for this purpose. However, the present illustrative 
embodiment uses a more refined approach to multi-level decoding-an approach referred to as multi-stage de- 
coding. This is a well-known technique, the details of which can be found in A. R. Calderbank. "Multilevel codes 
and multistage decoding," IEEE Trans. Comm. . Vol. COM-37, pp. 222-29, 1989, hereby incorporated by refer- 
ence. For present purposes, then, tt suffices to summarize. In overview, how the multi-stage decoding is car- 
ried ouL 

In particular, channel decoder 232 first recovers the bits encoded by coder 1142 within encoder 114 (FIG. 
5), independent of. and without reference to, any decoding performed on the bits encoded by coder 1141. To 
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this end as shown in FIG. 15. decoder 232 Includes decode 6, circuitry 2321. decode b, c.rcu.Uy 2323 and 
delay element 2322. In operation. Ihe received symbol signal is processed by circuitry 2321 to decode bit i), 
bv first finding the symbol closesl to the received signal symbot-and the associated metncs-in (Do, v Cly) 
and in (noo v n«). The trellis path is then extended as per conventional Vilerbl decoding of Ihe code imple- 
mented by coder 1142 (FIG. 5) to generate a final decision about a previously encoded information bit that 
was encoded by that coder. The decoded bil-one of the original most important bits-is provided as an output 
on lead 234 It is also re-encoded within circuitry 2321 using the code of coder 1142 to provide bit b, lo circuitry 
2323 as well as to channel decoder 231 (FtG. 1 6). as described below, via lead 236. A version of the received 
svmbol signal Is delayed by delay element 2322 by a time sufficient to provide the value of bit b, as just de- 
scribed That signal is then provided lo circuitry 2323 along with bit b, lo circuitry 2323 which then proceeds 
to decode bit b,. This is carried out. in particular, by first finding the symbol closesl lo the received signal sym- 
bol-and the associated melrics-in supersymbol Ch^ and in supersymbol O,,, The metrics are stored in a buf- 
fer and are used to perform maximum likelihood decoding of the code implemented by dear 1141 (FIG. 5) 
thereby to provide another of the most important bits on lead 234. At the same lime, that bil .s re-encoded 
within circuitry 2323 to provide bit b* to channel decoder 231 on lead 236. . , 

Umrbenoteda.lhispointlhal.obviously.circui.,ies2321 and2323mu^^^ 
aboul .he constellatioa lhat is being used in order ,o carry out Iheir respective (uncUons^ That 'ntorm^t on ^ 
illusuatively stored in a constellation store 2325 whose output-denoted as -A'-is provrfed to both of those 

circuiWes. as well as to decoder 231 of FIG. 16. w'-„~.;Horf 
Withihemost Important bitsnow provided on leads234 and thevalues of bits 6,and6.nowbemg provided 

to decoder 231 on lead 236. the multi-stage decoding can now proceed-within the latter channel decoder- 
.:fecover,helessimportantbit3.To.hisend.» 

2315. decode b, circuitry 2316. decode 6, circuitry 2317. and delay elements 2311. 2312 and 2313. In oper- 
ation the received symbol signal is delayed by an amount equal to the processing delay withm decoder 232 
so lhat circuitry ^315 can be provided with bits b, and b. at the same time that it receives Ihe received symbol 
signal Circuitry 2315 then proceeds by first finding. wBhin the supersymbol H,^ those symbols having 6„ = 
0 and b, ■= 1 which are respectively closest to the received signal symbol. The trellis path is then extended 
as before, using the metrics associated.with those two closest symbols, leading ultimately to a decoding of bit 
bo and hence a recovery of one of the less important bits. That bit is then re-encoded within circuitry 2315 so 
as to be able to provide the value of bit b. to circuitries 2316 and 2317. The latter operate n a manner similar 
to that described above with respect to the other decode circuitries to recover the other less jmportant bits 
with the delays of delay elements 2312 and 2313 being sufficient to enable each of the circuitnes 2316 and 
2317 to receive the re-encoded bits, as needed. 

Decoding in the case where mulfi-dimensional symbols are used is carried out in a similar manner, as will 
be appreciated by those skilled in the art . . ^ ki a i... A^^^,=nL 

The bits output by decoder 231 and 232 on leads 233 and 234. respcclwely. are desaambled by descram- 
blers 241 and 242. which respectively perform the inverse functionof scramblers 110 and 111 in the 
A television signal formatted so as to be displayable by an appropriate television set is then gene aled from 
the desaambler outputs by source decoder 253. thereby recovering the original television information, or in- 
lelliaence That signal is then presented to the television viewer on television set 260. 

The pe/formance of the overall unequal error protection signaling scheme implemented by the system of 
FIGS. 1 and 2. as just described, can now be characterized in terms of the nominal "<''"9 S^,^!;- 'r;""''"^ 
oain at very low error rates), this being the gain in signal-to-noise ratio over that of an uncoded 16-QAM system 
The gl orte most important bitsls 6.24 dB and fo, the less important bits is 2.70 ""-^2°' 
■ Slates of each of the convolutional codes is chosen lo be 16. The unique advantage of the present invention 
howeve , does not wholly lie with the particular levels of coding gain achieved. Coding 
b the prior art may achieve comparable, or even better, coding gain results in particular app ication^ 

where the invention is particularly advantageous is in its ability to provide the system designer with a greatly 
rnhanced rpabllity to pick the desired performance criteria, given the application, and to then readily arnve 
' at a coding scheme which meets those criteria. 75 ,„•, rts 

For example, the overall data rale of the above-described system can be '"^f '"""^"^ '"/.f.^ 
bits per symbol without affecting the coding gain by changing the code impten^ented by coders 1151 
to a rate R = 15/16 zer,.sum parity checkcode (and using 16-bit. rather than S-bit. ""^^ "i^ 
(Atthesamelime.thepercentageof most importantbitsbcreases ever so shghtl^^^^^^^ 

» As another example, the percentage of most important bits can be reduced lo ^^f ""^^^ '"^^^^^^^ 
lime increasing the level of error protection afforded to those bits by a) changing the "''^'"'f 
codere 1141 1142. 1152 and 1153. to respectively, a rate R = 7/8 punctured convolutional code, a rate R - 3/4 
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convolutional code; a rale R = 7/8 zero-sum parity check code; and a rate R = 3/4 convolutipnal cbde; and b) 
eliminating coder 115.1 so that the bits applied 16 buffer lIST^re uocbded bits^This arrangement achieves 
coding gains of 8 dB for the most important bits and 0.22 dB for the less irpijprtantbii^.Addittonany. by changing 
the ratio of dj/rf, in FIG. 4, one can trade off the gain^of the most important and less htiportant bits. It will 
thus be seen that the invention allows for the use of a virtually unlimited range of design parameters- including 
the code rates, code complexity, overall coding redundancy, fraction of that redundancy used for error projec- 
tion of the most important bHs (as opposed to that used for the less Important i)its)-in order to nieet desired 
system design criteria. This flexibility can be further enhanced by using various different sig nil 6bnsten at ions, 
including constellations having various different numbers of symbols, symbol spacings. supersyrnbol groupings 
and subset partitionings. Indeed a hew class of constellations may be advantageously used to provide the sys- 
tem designer with even further flexibility. These constellations are characterized by particular distance rela- 
tionships within the constellation. Indeed, an important parameter in the design of coded modulation schemes 
is the so-called inlra-subset distance. This parameter is the minimum distance betweeri any two' syrribois in 
the subset. In coded modulation schemes which, unlike in the preser^t invention, seek to provide equal error 
protection, the design constraint is to partition the constellation into subsets 1n such a way as to maximce the 
minimum of the intra-subset distances taken across all the subsets, this value, which we define as the "max- 
imum intra-subset distance.' or MID, has been achieved when, given a particular partitioning, any further at- 
tempt to increase the intra-subset distance of any particular subset (by making any other symbol-io-subset 
assignment changes) would not result in a further increase (n the aforesaid minimum value. ^ 

Further, an important distinction between equal error protection and unequal error protection schemes 
needs to be kept in mind In.the former, the error protection fdr the sorcalled coded bits is deterrhined by the 
minimum distance between subset sequences while the error protection for the uhcbded bits is determined 
by the minimum distance between the symbols within a sulJseL. Designers of equal-erroKprotection schemes 
want these two minimums to be as dose to each other as possible because I hey. want equal error protectk3n 
for all the data. The performance of these schemes is dominated by the distance between the symbols within 
a subset This results from the fact that one can always increase the complexity of the code in order to achieve 
whatever distance is desired between subset sequences. 

In the case of unequal error protection, by contrast, the symbols in a supersymbd are selected by the 
less important bits. Thus the distance between these symbols can be significantly less than the MID. Indeed 
it is limited only by the distancei between the syrhbols of the constellalioh as a whole. This (jislance is chosen'.^ 
to provide the necessary level of error protection for the less important bits. Once we fix that distance, then 
the subset partitioning can be done to take advantage of this fact, thus making possible the realization V great- • 
er distances between the supersyrnbol sequences than would be possible with convent iohal coded modulation 
for the same complexity. We are, thus, no longer constrained to keep the symbols within a supersyrnbol far 
away from each other. 

Taking the foregoing into account, constellations useful in unequal-error-protection signaling schemes are 
characterized by the fact that the minimum distance between at least some of the symbols of at least one of 
the supersymbols is less than the MID. Indeed, constellations of this general type are known. However, in the 
prior art. the minimum distance between the symbols of the supersymbols Is the same as the minimum dis- 
tance between the symbols of the constellation as a whole. By contrast, the constellations in question are not 
so constrained. That is, the minimum distance between at least ones of the symbols of atjeast one of Ih^ su- 
persymbols is greater than the minimum distance between the symbols of the coristellatioin as a wtiple while, 
again, still being less than the MID. Graphically speaking, constellations meeting this criterion will generally 
appear to have supersym bols whic h, atjgjastjq some degre e, overlap ( as do the subsets of the constellations 
used for equal error protection schemes). That is.'al least one symbol of a least one supersymboVwil) be closer 
to each of a pair of symbols of a different supersyrnbol than that pair of symbols are to each other. 

One Hlustrative, 32-symbol, constellation embodying these principles is shown in FIG. 7. This constellation 
is partitioned into four supersymbols. the constituent symbols thereof being labelled A, B, C and D, respec- 
tively. The distance labelled as "X"can be, for example, "1", thereby providing a constellation whose individual 
symbols are uniformly spaced. Or "X" can be greater than one-such as V3-thereby increasing some of the 
inter-supersymbol distances. This provides an additional degree of design freedom in terms of achieving par- 
ticular desired levels of error protection. 

The MID of the constellation of FIG. 7 Is "2", which can be verified from a consideration of FIG. 8, in which 
the same constellation has been partitioned in order to provide equal error protection. That is, the minimum 
distance between any two symbols labelled "A", for example, is, in fact, "2". In FIG. 7, by contrast, the corre- 
sponding minimum distance, In accordance with the invention; is less than •2". Specifically, it is V2. And note 
that, from a graphical perspective, subsets A and B overlap one another, as do subsets C and D. (It Is thus 
not possible to draw a box around the supersymbols, as was done in FIG. 4.) 
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Another illustrative constellation-this one having 64 symbols-is shown in FIG. 9. Again, the constellation 
is partitioned into four supersymbols labelled using the same labelling convention as that used for FIG. 7, 

FIGS 10-14 show yet further constellations that can be used to advantage in conjunction with the present 
invention. The same labelling conventions are used and thus nothing further need be said about the config- 
uration of these constellations. . t . # 

The following two tables illustrate the tremendous flexibUitv provided by the pr esent invention in terms of 
oroviding unequal-error-protection signaling schemes which provide various different combinations of a) per- 
centage of most important bits, b) degree of overall code redundancy, c) coding gains, and d) ratio of peak- 
to average power (which is an important consideration in power-limited channels such as terrestrial and sat- 
ellite telephone channels). TABLE 1 is a table of codes in which 25% of the bits constitute the most important 
bits TABLE 2 is a table of codes in which various other percentages of the bits constitute the most important 
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TABLE 1 



Example 


Sigiial 
Corutellatioa 


Code Co for 
important biu 


Codec, forlcis 
important bits 


4A 

25% mosl imporuni 
dam 
ratc4-l/X. 


Fig. 10 
P = Sn.PAR = 1*7 

1 4, if a* = Fd 
t 1. if oAjfecrf 


[2335]: 16- 
state. rale 1/2 
convolutional code 
rf'(Co) = 11 
r = 7.4 db 


single parity check 
code with 
redundancy 1 /L 
rf'(C,) =2 
y ~ OdB 


4B 

25% most important 
data 
rai£4-2/L 


Fig. 7 
P = 3.(n,PAR = 1-7 

4. if oA = cd 
3. if o6 « cJ 
I I, if « cd 


[6J1): 16- 
state.fai£ l/l 
convotuliorul code 
rf^(Co) = 14 
r = 7.6dB 


single parity check 

code over f f < 
with redundancy 2/L 
d^iC,) « 4 
T = Zl2dB 


4C 

25% most imponajit 
data 
rate 4-1/1 


Hg. 11 
P ^ 5.25. PAR = 1-7 

1 10. if « erf 
1 2, if at * erf 


(23 J5): sec 
Example 4A 
rf'(Ce) - 26 
r = 7.91 dB 


single parity check 
code with 
redundar)cy IfL 
rf^(C,) =4 
T = 0.21 dB 


4D 

25% most imponim 
data 
rate4-2/i 


F»g. 12 
A* = U^PAR = 1-86 
rf'(no.n») = 25 


single parity check 
code wi(b 

'redundancy l/L 
rf'(Co) -50 
r= 7.54dB 


[23351: sec 
Example 4A 
& 

parity check 
. rf*(Ce) « 14 
T= Z20dB 


4E 

25% most imponant 
data 
ratc4-l/L 


Fig. 9 
(4+24x+140x')/32 

l+x*. if c5 sr erf 
jc* , if a5 B erf 
[ 1 , if 06 s erf 
PAR = 2 05forx « 03 


X r(dB) 
o74 (23,35) 4.92 
0.3 [23,351 6.11 
0.2 [23.351 1.90 
0.1 [23.35] 10.10 


2-levelcodc: sec 
Example 4D 

rf^Co) » I4x' 
X 7<dB) 
0.4 3.96 
0.3 3.25 
OJ 1.91 
0.10-1.46 
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TABLE 2 



Example 


Signal 
ConstcUuion 


Code Co for 
imporuni biu 


CodeCi focJcji 
imporuntbtu 


4F 

50% imporuni 
dala 
raie4-I/L 


Fig. 13 
r « laS. PAR « 2-33 

5, if at - cd 
2. if at " erf 
1, if o6 = erf 


state, nut 1/2 
convolubonai code 
rf'(Co) « 16 
r = 5.8 dB 


lingle parity chock 
oodcwiih 
redundancy \tL. 
rf»(C,) « 8 
T« 18dB 


40 

33% importHii 


Rg.n 

P = 5.75, FAR - 1*7 
sec Example 4C 


2-lcvcl code: - 
(52^,76): 16-$taic 
me 1/3 convoluoonal 
code.rf)r » 12 
A 

pariry check 
rfVCo) - nin( 12x2. 2x10) 
» 20 
r » 6.8dB 


2-JcvtIcode:- 
fJU31wiih 
Hincluring lulc 

|&.sute. rate 2/3 
codcrfjr « 5 

parity chock 
rf'(C„ - 
min(5x8.2xl6. 64) « 32 
f « 2.8 dB 


4K 

37^% iinpOTUnt 
dau 


Fig. JO 
/» = 5.25. m « 1-76 
5CC Example 4C 


2-levd code: - 
123J5J: 16-sute 
me 1/2 oonvolutional 
codc,rfir « 7 
& 

paricychodt 
rf'(Co) « min(7x2, 2x 10) 
« 14 
r - 5.3dB 


2.tevdcodc:- 
reic 2/3 punctured 
convotutional code 
b«n£xamptc4C 
&. 

16-staie,nie7/8 
puncQncd convoluoonal 
codewiihrfff = 3 
rf'(C,) - 
min(40.3xl6. 64) « 40 
Y = 3.76 dfl 
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TABLE 2 ContU 





Eumple 


Signal 


Code Co for 


Code C) for less 


IS 




Constellation 


important bits 


important bits 






2-!cvel code: - 
rate 3/4 convolutional 


3-lcvcl code: - 
rate 1/2 coovotadonal 
code from Example 4A 




4J 


Fig. 4 


code £rofn Example 4F 


k 




43.75% important 


F = 4.75, m - 1-9 




rate 3/4 convotutiorul 


20 






paiiiy chock 


code bom Example 4F 




raic4+l/4-2/£. 


1 8, if = c5 


</'(C() - miB(4x4.2x8) 


k 






\ 4. ifofr » c(/ 


« I(S 


parity check 






r = 6.24 dB 


rf*(C,) - 7 
T 2.7dB 


?5 






3-levelcode:. 
me 1/2 convolutional 








fig. 14 . 


ctxle from Example 4A 


. 2-Ievd code: - 




4K 


F "= 16|^./'AJ<I B 1-63 


& ■ , . ■ 


rate 3^ coovolutioral 




56^% imponam 




rate 3/4 convotuiionaJ 


code bom Example 4F 


30 




code £rom Example 4F 


k 


nitc4-2/t 


9. ife - 7 




parity check 






18. iffcc - r/ 


parity check 


</'(C,) = 16 






d'(Cfl) = mb(63, 72. 72) 


, T = 0.78 dB 






36. ifo!)c - 5c/ 


« 63 r = 6.73 d& 




35 


4L 




P3J51with 
punctxdttg rale 






22^% imporunt 


Hg. 12 


[1010011. IIOOIOJ 


see Example 4D 




dau 


F = It.y^ « 1-86 


to give 16-siatc 


rf'(C,) = 14 




raic3+7/8-i/Z, 


rf^COo. n,) « 25 


rate 7/8 ooovolulional 


t = 1.27 dB 




. (power penalty) 




code «ritb if;r > 3 




40 


0.75 dB 




rf'(Ce) -75 
r = 8.55 dB 





45 



In these tables. P denotes the average power per dimension; PAR denotes the peak-to- average power 
so ratio; denotes the square Euclidian distance between the supersymbols represented by its arguments; f 
denotes the nominal coding gain for the more important bits: y denotes the nominal coding gain for the less 
important bits: and [ffi^il is the generator matrix, in octal notation, for the convolutional codes indicated: L is 
the length of the parity check code. For non-uniform constellations, the degree of non-unrformity is determined 
by X. The tables also show the achievable gains as a function of x. 
55 In designing unequal error protection signaling schemes, such as those just presented In TABLES 1 and 

2. one typically must first be given the values of certain parameters. These include (a) avaflabte channel band- 
width, (b) the worst-case channel SNR, (c) the number of classes of bits, (d) the percentage of bits in each 
class, (e) the desired quality of the final received signal under the worst-case channel conditions, (f) acceptable 
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decoder complexity, and (g) peak- to- eve rage power ratio. One can then proceed to design an unequal-error- 
prolecllon scheme consistent with the given parameter values. 

Typically, one might begin by choosing the signal constellation to allow for about one overall bit of redun- 
dancy per syWibol. The number of supersymbols that is needed is determined by the actual number of important 
bits per symbol. For example, if more than 25%. and less than 50%. of the bits are important, and if the avaBable 
bandwidth and required overall bit rate dictate, say. four information bits per symbol, then we will have to trans- 
mit one Important bit per symbol. Assuming, further, that it is desired to provide some amount of redundancy 
for the important bits and that those bits will be used to select the supersymbols. then it may be reasonable 
to use a two-dimensional constellation having four supersymbols. Various of the constellations disclosed here- 
in or any other desired constellalfon. can be used as the initial design choice. One would then proceed to select 
codings to be used for the bit streams depending on the relative redundancies desired to be allocated to them 
Importantly the use of multi-level codes, in accordance with the p resent invention, can facHitate the attainment 
of the desi/ed design criteria. If. upon anaTysis. it appears that thi^islFed quality at the wbret-case;SNR « ■ 
not achieved with the design arrived at to this point, other constellations and other codes can be explored 
with a view toward seeing whether it can. in fact, be achieved. If this does not appear possible, one or more 
of the previously given constraints, such as acceptable decoder complexity, may have to be relaxed. Other 
design criteria are conceivable as well as other parameters that may affect the choice of the code design. 
/ In accordance with an advantageous technique for assigning the values of the bits that are used to select 
/ the symbols from each identified supersymbol to those symbols, a pair of symbols from respective different 
I supersymbols are assigned to the same less-important-blt values if the distance between that pair of symbols 
i is the minimum distance between any pair of symbols of those two supersymbols. Such a scheme is illustrated 
in FIG. 10, in which, like in FIG. 4, each symbol is labelled with a bj. ^^i. set of values. Note, for example, 
that the symbols labelled 110 in each of the supersymbols Ooo. Hoi. n^o and fl,, all satisfy the aforementioned 
criterion. Such a labelling scheme-which is achievable to varying degrees, depending on the constellation and 
supersymbol geometries-is advantageous in that it improves the probability that the less-important-bit values 
will be decoded properly, even if an error is made in recovering the correct supersymbol sequence. Beyond 
this, it may be possible to achieve former benefit by similar judicious choice of bit assignments for those sym- 
bols which do not meet the above-mentioned minimum distance criterion. This would need to be done, however, 
within the constraints that are imposed by any coding that is implemented for the symbols within the super- 
symbol, as was. in fact, the case of the example described above in conjunction with the constellation of FIG. 
4 

The foregoing merely illustrates the principles of the present invention. For example, although the Dtus- 
trative embodiments are implemented using two data streams- the most- and less-important-t he invention 
can be used in schemes which include three or more streams. Additionally, although two-dimensional constel: 
lations are shown, the invention can be used in schemes using constellations with more than two dimensions. 

It may also be noted that although the invention is illustrated herein as being implemented with discrete 
functional building blocks, e.g.. source coders, scramblers, etc., the functions of any one or more of those build- 
ing blocks can be carried out using one or more appropriate programmed processors, digital signal processing 
(DSP) chips, etc. 



Claims 



Apparahjs for communicating information comprising 

means (104) for generating a digital signal representing the information, the digital signal being 
comprised of at least f irst and second streams of data elements, 

CHARACTERIZED BY 

means (110. 111 . 114, 115. 131) for channel mapping the digital signal in such a way that the prob- 
ability of channel-induced error for the data elements of the first data stream is less than the probability 
of channel-induced error for the data elements of the second data stream, said channel mapping means 
including means (114) for mullHevel coding at least one of said streams, and 

means (141. 151) for transmitting the channel mapped signal over a communication channel. 

The invention of claim 1 wherein said information is television signal information and wherein first stream 
of data represents television signal informatton that is more important than the televiston signal informa- 
tion represented by the data elements of said second stream. 

The invention of claim 1 wherein said at least one of said streams includes at least two substreams. and 
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wherein said multi-level coding means includes means (1141. 1142) lor redundancy coding at least one 
of said substreams and for combining all of the redundancy coded substreams of said one stream and 
any of its substreams that are not redundancy coded to form a coded signal for use in the channel map- 
ping. 

The invention of claim 3 wherein the channel mapping means selects a sequence of symbols from a pre- 
defined constellation to represent the data elements, the constellation being comprised of supersymbols. 
the minimum distance between the symbols within at least one of the supersymbols being less than the 
maximum intra-subset distance for said constellation. 

The invention of daim 4 wherein the minimum distance between the symbols of said at least one of the 
supersymbols is greater than the minimum distance between symbols of the constellation as a whole. 
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FIG. 3 
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FIG. 5 
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FIG. 7 
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FIG. 10 
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FIG. 13 
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FIG. 15 
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